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1  Introduction 


This  document  reports  the  progress  to  date  for  the  optical  wavelet  transform  processor 
program.  The  program  started  in  June  1993.  The  activities  that  occurred  during  the 
first  quarter  of  the  program  can  be  summarized  as  follows:  1)  the  program  kickoff 
briefing  was  given  at  ONR  on  2  June  1993;  2)  a  simulation  of  the  output  of  the  wavelet 
transform  optical  processor  has  been  constructed  with  initial  outputs  generated;  3)  a 
paper  entitled  “Optical  time-integrating  wavelet  transform  processor”  was  prepared 
and  presented  at  the  Annual  Optical  Society  of  America  Meeting  in  Toronto,  Canada 
on  5  Oct.;  4)  design  modifications  of  the  support  electronics  to  the  real-time  hybrid 
optical  processor  to  be  used  in  this  study  were  planned.  Section  2  will  summarize 
the  basic  technology  used  in  the  optical  wavelet  transform  processor.  Section  3  will 
discuss  the  first  quarter  accomplishments  of  the  program.  Section  4  will  outline 
the  next  quarter  plans  of  the  program.  Laistly,  the  viewgraphs  used  in  the  OSA 
presentation  will  be  included  as  an  appendix  in  this  report. 

2  Background 

2.1  Wavelet  distributions 

A  new  representation  of  information  that  has  garnered  considerable  recent  interest 
is  the  wavelet  distribution  of  data.  This  distribution  analyzes  the  local  variation  of 
signals  (e.g.  temporal  waveforms,  images,  etc.)  through  a  set  of  analyzing  functions 
commonly  called  wavelets.  These  euialyzing  functions  are  each  scaled  versions  of  a 
basic  function  called  the  “mother  wavelet.”  The  wavelet  distribution,  Ts{r,a),  is 
obtained  through  a  correlation  between  the  input  data  and  each  wavelet  as 

T,(r,a)  =  J  ~ 

or  by  incorporating  the  scale  into  the  signal  as 

Ts{r,  a)  =  j  3{ar})h{T]  -  r)dri  =  /i(r')  *  s(r',  a)  (2) 


where  s(r)  is  the  input  signal,  h{r,a)  is  the  analyzing  wavelet  at  scale  a,  r'  =  r/a 
and  *  denotes  correlation.  Note  that  for  input  spatial  images  we  will  use  the  notation 
s(f)  =  s{x,y).  In  this  instance  the  wavelet  distribution  of  s(f)  is  a  four  dimensional 
representation  denoted  as  Ts(f,  o)  with  a  =  (oi,  Oy). 

The  distribution  of  the  correlations  between  the  input  signal  and  the  entire  set 
of  wavelets  constitutes  a  decomposition  (exact  in  the  limit)  of  the  signal  into  how 
feist  the  signal  is  changing  (“scale”)  and  where  it  is  changing  (“space”).  The  wavelet 
distribution  is  also  known  as  a  space  (time)-scale  distribution.  In  this  regard,  the 
wavelet  distribution  is  closely  coupled  to  the  general  class  of  time-frequency  distribu¬ 
tions  which  try  to  depict  a  signal  in  terms  of  its  local  spectrum  [2].  A  similar  class 
of  distributions  for  time-scale  has  been  proposed  which  closely  mirrors  the  formula¬ 
tion  for  time-frequency  [3].  It  has  also  been  shown  that  one  can  derive  members  of 
the  time-scale  class  of  distributions  through  an  appropriate  operation  on  members  of 
the  time- frequency  class  [3].  An  oft  cited  example  is  the  wavelet  transform  being  a 
smoothed  version  of  the  Wigner  distribution  function. 

2.2  Wavelet  Optical  Processor  Implementation 

As  noted  in  Section  2.1,  the  wavelet  distribution  of  an  input  image  is  a  4-D  repre¬ 
sentation  of  the  2-D  function.  This  added  dimensionality  incurs  some  difficulty  for 
optical  implementations  due  to  their  inherent  2-D  nature.  Most  of  the  successful 
work  in  the  real-time  implementation  of  time-scale  or  time-frequency  distributions 
of  signals  have  been  applied  to  temporad  1-D  signals  (whose  representation  is  then 
2-D)  where  the  2-D  nature  of  optical  processors  can  be  applied  naturally.  For  a  4-D 
representation,  new  degrees  of  freedom  must  be  found  in  the  optical  processor  which 
can  be  exploited.  Examples  of  these  degrees  of  freedom  are  wavelength,  polarization, 
spatial  multiplexing,  angular  multiplexing  and  time. 

The  basic  implementation  that  we  are  pursuing  in  this  study  is  a  hybrid-optical 
system  based  on  a  time-integrating  architecture.  This  optical  architecture  is  based  on 
synergistic  use  of  optical  and  electronic  componentry  to  maximize  performance.  The 
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basic  elements  of  the  optical  system  are  laser  diodes,  acousto-optic  spatial  light  mod¬ 
ulators,  electronic  solid  state  cameras,  and  the  baisic  triple  product  processor  optical 
architecture  [4].  We  feel  that  this  implementation  is  the  most  naturally  synergistic 
with  imaging  sensors  and  affords  the  most  general  capabilities  of  wavelet  transform 
processors  based  on  optical  technology.  The  reasons  that  a  time  integrating  frame¬ 
work  are  most  suitable  are: 

•  Imaging  systems  (e.g.  FLIR,  CCD  cameras,  SAR)  perform  their  data  readout 
in  a  sequential  manner.  Formulating  a  processor  which  operates  on  the  data 
as  it  is  read-out  reduces  processing  latency.  In  this  case  the  input  image  s(r) 
becomes  a  time  sequential  data  stream  as  s{t)  =  s{x,y)5{x  —  nAxt  —  mApT). 

•  ERIM’s  hybrid-optical  systems  are  based  on  acousto-optic  technology.  This 
technology  allows  the  use  of  a  general  class  of  analyzing  wavelets  and  allows 
for  bipolar  operation  in  a  natural  manner.  No  encoding  must  be  made  to 
accommodate  the  bipolar  nature  of  the  analyzing  wavelet. 

•  Hybrid-optical  systems  have  been  extensively  studied  and  implemented.  Their 
packaging  potential  (size,  weight,  power)  has  been  assessed  and  have  been  shown 
to  be  superior  to  digital  electronic  systems  [5]. 

•  Hybrid-optical  systems  provide  another  degree  of  freedom  (time)  which  can  be 
combined  with  space,  angle,  and  wavelength  for  best  overall  performance. 

The  hybrid-optical  time-integrating  approach  can  be  contrasted  with  other  meth¬ 
ods  of  producing  the  wavelet  transform  of  2-D  inputs  [6,  7,  8,  9, 10].  These  approaches 
are  based  upon  the  use  of  2-D  spatial  light  modulators  (SLM)  for  both  the  input  and, 
in  many  cases,  the  wavelet  kernels.  These  systems  are  typically  only  amenable  to 
using  one  extra  degree  of  freedom  (spatial  multiplexing,  angle  multiplexing,  etc.)  in 
their  design  and  cannot  be  reprogrammed  (different  wavelet  kernel)  on  the  fly.  In 
many  of  these  approaches  the  wavelet  kernel  is  transformed  into  a  frequency  domain 
spatial  filter  such  that  the  traditional  4/  coherent  optical  processor  can  be  used. 
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These  filters  can  be  angularly  multiplexed  and/or  spatially  multiplexed.  Unfortu¬ 
nately,  when  multiplexed  in  this  manner,  the  system  is  “hardwired”  only  to  those 
WrtVelet  scales.  In  this  situation,  the  total  number  of  scales  that  can  be  used  is  de¬ 
fined  by  the  number  of  filters  that  can  be  multiplexed.  For  angular  multiplexing  [7], 
the  number  of  filters  that  can  be  used  is  defined  by  the  dynamic  range  of  the  holo¬ 
graphic  recording  media.  This  is  typically  limits  the  number  of  scales  to  5-6.  For 
spatial  multiplexing  [6],  the  space-bandwidth  product  (SBP)  of  the  SLM  limits  the 
number  of  scales  and  the  SBP  of  the  input  image.  Either  a  very  small  number  of  scales 
can  be  used  or  very  small  SBP  input  images.  Grey  scale  two-dimensional  SLMs  are 
not  very  amenable  to  temporal  multiplexing.  When  binary  wavelets  (Haar)  are  used, 
magneto-optic  devices  can  be  brought  to  bear  [8].  These  architectures  suffer  from  the 
need  to  encode  the  bipolar  nature  of  the  wavelets,  however.  Other  architectures  rely 
on  e.g.  shadowcasting  approaches  [9]  which  require  techniques  such  as  polarization 
encoding  to  accommodate  the  bipolar  wavelet  kernel.  Lastly,  there  are  techniques 
[7]  that  rely  on  the  physical  motion  of  a  lens  or  filter  wheel  for  operation  which  is  a 
distinct  drawback  for  remote,  real-time  operation. 

In  the  next  two  subsections,  we  will  describe  two  optical  architectures  for  wavelet 
transform  processing  that  we  are  evaluating  for  application  suitability.  The  first  ar¬ 
chitecture  analyzes  image  data  produced  by  an  optical  camera,  FLIR,  etc.  These 
sensors  normally  use  a  serial  readout  of  their  detector  elements.  The  second  archi¬ 
tecture  operates  on  spatial  spectral  data.  This  type  of  processor  is  most  suited  for 
sensors  which  measure  the  far  field  distribution  of  scenes  (e.g.  SAR).  This  proces¬ 
sor  operates  directly  on  the  spatial  spectral  data  produced  by  the  sensor  (also  in  a 
sequential  manner)  and  produces  the  wavelet  decomposition  of  the  scene. 
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2.3  Image-based  Wavelet  Processor 

The  basic  optical  architecture  that  we  will  employ  in  the  image  based  wavelet  trans¬ 
form  processor  is  the  triple  product  processor  defined  as 


^(Tl,r2)  =  J  u{t)v’{t- Ti)x{t  +  T2)dt  (3) 

and  shown  in  Figure  1.  In  this  architecture,  a  separable  wavelet  kernel 

h{f)  =  hi{x)h2{y)  (4) 

is  inserted  into  the  two  acousto-optic  cells  as 

u’(f  — Ti)  =  hi(t  —  x)  (5) 

x{t  +  T2)  =  h2{t-y)  (6) 

and  the  input  signal  is  inserted  into  the  laser  diode  as 

u{t)  =  s{at).  (7) 


This  decomposition  mirrors  the  form  of  the  wavelet  transform  as  written  in  Equation 
2.  The  selection  of  the  scale  of  the  wavelet  transform  is  defined  by  the  rate  at  which 
the  input  data  is  read  into  the  optical  system.  Recall  that  it  is  the  relative  scale 
between  the  wavelet  kernel  and  the  input  signal  that  is  being  analyzed.  The  scale 
of  the  wavelets  remain  the  same  and  are  repeatedly  inserted  into  the  AO  cell.  The 
selection  of  multiple  parallel  scales  is  accomplished  via  a  wavelength  multiplexed 
multichannel  system  where  each  scale  occupies  a  separate  wavelength  as  shown  in 
Figure  2.  Lastly,  since  the  analyzing  wavelets  are  inserted  into  the  AO  cells,  any 
bipolar  wavelet  can  be  easily  accommodated. 
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hi(t) 


Detector  Array 


Figure  1:  Wavelet  transform  processor  based  on  time-integrating  triple  product  pro¬ 
cessor  architecture 


Figure  2:  Wavelet  transform  processor  which  can  produce  multiple  parallel  scales  via 
wavelength  multiplexing 
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2.4  Spectral- based  Wavelet  Processor 

The  data  for  aperture  synthesis  systems,  such  as  for  SAR  and  for  magnetic  resonance 
imaging  (MRI),  is  generated  as  a  serial  stream  of  samples  that  fills  a  2-D  Fourier 
transform  space  (i.e.  spatial  spectral  space)  of  the  desired  image.  Wavelet  processing 
of  this  kind  of  data  can  be  expressed  by 

Ur,a)  =  T,D{S{f)H'if,a)}  (8) 

where  /  is  the  spatial  spectral  space  position  vector,  a  is  the  scaling  position  vector, 
H{f,d)  is  the  Fourier  transform  of  the  wavelet  h{f,d),  S{f)  is  the  spectral  data,  * 
represents  conjugation,  and  ^^20  is  the  2-D  Fourier  transform  operator.  We  note  that 
position  /  is  a  function  of  time  encompassing  the  conv^ersion  of  the  serial  data  time 
stream  into  2-D  spatial  space.  Thus,  the  basic  processing  is  to  take  a  2-D  Fourier 
transform  of  the  product  of  the  indicated  terms  with  wavelet  scale  cis  an  independent 
parameter.  The  baisic  processing  technique  is  illustrated  in  Figures  3  and  4.  Figure  3 
shows  the  processing  block  diagram  and  Figure  4  shows  the  optical  implementation 
using  a  2-D  Fourier  Transforming  Interferometric  Processor.  The  input  serial  signal 
is  electronically  multiplied  and  then  inserted  into  the  optical  portion  of  the  processor 
as  a  2-D  formatted  spatial  input  signal.  The  output  wavelet  transform  is  continually 
being  formed  as  the  data  flows  into  the  processor.  For  the  setup  shown  in  Fig.  4  the 
'^arious  scaled  versions  of  the  wavelet  would  be  generated  by  repeating  the  operation 
for  each  desired  scale.  For  fzister  operation  the  system  can  be  multiplexed  in  time, 
space,  or  wavelength  to  form  a  set  of  scaled  wavelet  transforms  during  one  data 
acquisition  time. 

For  time  multiplexing  we  depend  on  the  processor  being  much  faster  than  re¬ 
quired  for  a  single  wavelet  transform.  Each  section  is  processed  and  the  output  is 
summed  to  the  appropriate  memory  section  by  buffering  sections  of  the  input  signal 
and  interlacing  the  sections  after  being  multiplied  by  the  appropriate  wavelets  sec¬ 
tions.  (See  Fig.  5.)  Thus,  all  the  different  scaled  wavelet  transforms  are  being  formed 
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Figure  3:  Time  integrating  Fourier  transform  wavelet  processor 
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Figure  4:  Time  integrating  wavelet  proces,  or  based  on  Fourier  transform  interfero¬ 
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Figure  5:  Time  multiplexed  wavelet  processor 

in  a  cyclic  fashion  such  that  all  the  wavelet  transforms  have  been  formed  during  one 
data  acquisition  time. 

Spatial  multiplexing  can  be  done  as  illustrated  in  Fig,  6.  It  depends  on  the  pro¬ 
cessor  having  excess  space-bandwidth  product  capability.  By  encoding  each  wavelet 
on  a  different  carrier  and  multiplying  the  incoming  data  with  the  sum  of  the  encoded 
wavelets  the  various  scaled  wavelet  transforms  come  out  at  different  positions  in  the 
output.  In  this  case  all  the  wavelet  transforms  are  being  formed  simultaneously. 

Wavelength  multiplexing  is  illustrated  in  Fig.  7.  In  this  case  the  technique  de¬ 
pends  on  the  fact  that  the  optical  portion  of  the  processor  can  run  in  parallel  for  dif¬ 
ferent  wavelengths.  Each  one  of  these  wavelength  channels  produces  its  own  different 
scaled  wavelet  transform.  Thus,  all  the  wavelet  transforms  are  formed  simultaneously. 

Of  course,  mixed  multiplexing  using  some  combination  of  the  three  techniques  is 
also  possible  to  increase  the  processing  throughput  even  further. 
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Figure  6:  Spatial  multiplexed  wavelet  processor 
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Figure  7:  Wavelength  multiplexed  wavelet  processor 
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3  Progress  to  date 


We  have  simulated  the  output  of  the  spectral-based  wavelet  transform  optical  pro¬ 
cessor.  All  of  the  salient  operations  have  been  incorporated  into  the  simulation. 
Examples  of  these  operations  are:  multiplying  the  spatial  spectrum  data  of  a  scene 
by  the  transform  of  the  wavelet  kernel  (equation  8);  modulating  the  resultant  data  by 
a  carrier  and  adding  a  bias  to  the  signal;  performing  the  cosine  transform  on  the  spec¬ 
tral  data;  simulating  the  detection  process  incorporating  photon  noise;  demodulating 
the  detected  output  into  a  complex  image. 

The  input  scene  that  was  analyzed  consisted  of  a  set  point  targets,  each  with  a 
random  phase  ((^  ~  [/[— 7r,7r]),  in  the  configuration  of  a  E.  The  spatial  spectrum  of 
the  scene  was  then  obtained.  This  spatial  spectrum  was  treated  as  the  collected  data 
from  a  synthetic  aperture  radar.  The  spatial  spectrum  of  the  scene  was  then  processed 
in  subsets  in  azimuth  as  shown  in  Figure  8.  The  partitioning  of  the  spatial  frequency 
aperture  in  azimuth  is  equivalent  to  analyzing  the  scene  via  a  modulated  sin{x)/x 
function  as  the  mother  wavelet.  The  scales  of  the  analyzing  wavelet  were  chosen  to  be 
equivalent  to  an  octavel  decomposition  of  the  input  scene.  An  octavel  decomposition 
is  the  basis  for  rr  ost  discrete  wavelet  decompositions  of  signals.  The  simulation  shown 
in  Figure  9  shows  the  time-integrating  nature  of  the  optical  processor  whereby  each 
“image”  is  a  sample  of  the  post  detection  digital  summation  memory  of  the  processor 
(see  section  1.4).  As  the  spatial  spectrum  is  being  inserted  into  the  system  and 
processed  the  partial  result  is  contained  in  the  post  detection  memory.  The  state 
of  that  memory  at  any  particular  time  corresponds  to  a  specific  analyzing  wavelet 
scale.  The  figure  shows  variation  in  the  signature  cis  a  function  of  scale.  In  addition, 
the  figure  shows  that  a  very  high  dynamic  range  output  can  be  attained  when  the 
system  is  photon  noise  limited.  These  results  were  presented  at  the  Optical  Society 
of  America  annual  meeting  in  Toronto,  Canada  on  5  Oct.,  1993  [11]. 
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Figure  8:  Partitioning  of  the  spatial  spectrum  to  generate  a  modulated  sin{x)lx 
analyzing  wavelet. 

Multiresolution  expansion  in  y  only 
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Figure  9:  Wavelet  time-integrating  optical  processor  simulation  output  for  modulated 
sin{x)fx  wavelet  with  point  target  input  scene. 
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4  Future  Plans 


The  simulation  of  the  time-integrating  wavelet  transform  optical  processor  will  be 
further  enhanced  to  incorporate  detector  read  noise  and  the  use  of  two  dimensional 
wavelet  ke-  ;  These  enhancements  are  simple  extensions  of  the  current  capabilities. 
In  addition,  the  pre-  and  post-optical  electronic  systems  of  the  hybrid  processor  will 
be  reconfigured  such  that  modulation  by  the  wavelet  kernel  can  be  accomplished  and 
the  post  detection  memory  can  be  sampled  such  that  multiple  scenes  analyzed  at 
different  scales  can  be  easily  read  out.  It  is  anticipated  that  a  full  demonstration  of 
the  optical  processor  will  be  held  in  the  fourth  quarter  of  this  program. 
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A  OSA  Presentation  Viewgraphs 
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OPTICAL  TIME-INTEGRATING  WAVELET 
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IMAGE-BASED  WAVELET 
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•  Scale  is  encoded  into  the  input  signal  u{t)  =,  s{at)  which  is  inserted 
into  the  laser  diode 

I 

•  Analyzing  kernel  must  be  separable  h[f)  =  h,i(^x)h2{y)  and  inserted 
into  the  two  acousto-optic  cells 
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FOURIER  TRANSFORM  INTER- 
WRIM  FEROMETER 


Data  (Fourier  coefficient)  inserted  into  laser  diode 
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